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SEGMENT STILL 
IMAGE INTO 
BLOCKS 



CREATE MODEL 
SURFACE FOR 
EACH SEGMENT 



OPTIMIZE 
MODEL 
SURFACE OF 
EACH SEGMENT 



CONNECT SEGMENTS 
TO CREATE ENTIRE 
MODEL IMAGE, I.E. 

"SCULPTURE" IMAGE 



GENERATE "TEXTURE- 
IMAGE FROM 
ORIGINAL AND MODEL 
IMAGES IF PSNR < Pq 



STANDARD LOSSY 
COMPRESSION OF 
TEXTURE IMAGE AND 
STANDARD LOSSLESS 
COMPRESSION OF 
SCULPTURE AND 
TEXTURE IMAGES 



TRANSMIT OR 
STORE 



FIG. 9 



TAKE NEXT 
STILL IMAGE 
OR lo FRAME 



SEGMENTATION OF lo 
(create blocks of pixels, e.g. 
16 X 16 square blocks into 
many Iq) 



CALCULATE DYNAMIC 
RANGE (R) 
R=max(io)-min(io) 
(subtract maximum intensity 
pixel in that segment from 
minimum intensity pixel) 




YES 



TAKE CANONICAL 
POLYNOMIAL 
FROM TABLE 



FIG, 10A 



FIND SUBSTITUTES FOR VARIABLES IN 
CANONICAL POLYNOMIALS TO CALCULATE F^odeied 

^canonical - ^1^ +X1X22 

WHERE 

X, = yi + a,yi2 + .... 
X2 = y2 + biyz^ + .... 

^modeled = (yi+ayi2)3 + (yi+ayi)(y2+by22) 



CREATE MATRIX (or modeled 
surface) BY SUBSTITUTING 
COORDINATES OF EACH PIXEL 
INTO Fp,odeied TO GET F„i.i; F„,i.2 . . 
(This IS a matrix version of Fmodcied) 



CALCULATE Q BY DETERMINING 
DIFFERENCE BETWEEN ORIGINAL 

AND MODELED SEGMENTS USING EQUATION: 
Q = E((io)-(i J)2 

(i.e., subtract corresponding pixel from io, the origmal 
segment, from im, the modeled segment) 



(TRY NEW 
COEFFICIENTS 

IN SAME 
POLYNOMIAL) 




FIG. 10B 



STORE Q PLUS GOOD 
COEFFICIENTS FOR THAT 
POLYNOMIAL 



TAKE I^fEW 
POLYNOIMIAL 
AND SOL^ E FOR 
COEFFICIENTS 
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CHOOSE THE POLYNOMIAL 
HAVING THE LOWEST Q OF 
THE POLYNOML\LS IN THE 
LIBRARY 



STORE ALL COEFFICIENTS 
FOR THE POLYNOMIALS 

FOR EACH SEGMENT; LE. 
STORE COEFFICIENTS OF 
Fmodeled POLYNOMIALS 



TAKE CURRENT 
SEGMENT 
FROM ABOVE 
BLOCK 



FIG. IOC 



FIND CONNECTION BETWEEN ADJACENT SEGMENTS 
BY EXTENDING SURFACE OF SEGMENT 1 INTO 
SEGMENT 2 AND FINDING DIFFERENCE BETWEEN 
EXTENDED SURFACE AND SURFACE OF SEGMENT 2. 

DO THIS BY FINDING AVERAGE DISTANCE, d, 
BETWEEN THE SURFACES. IF AVERAGE DISTANCE d 
IS SMALLER THAN A THRESHOLD VALUE, THEN 
APPROXIMATE SURFACE OF SEGMENT 2 BY THE 
EXTENDED SURFACE, I.E. THROW OUT SEGMENT 2 
SURFACE. IF GREATER THAN THRESHOLD, FIND 
CONNECTION USING SPLINES (NEXT BLOCK) 



CALCULATE 
SPLINES WITH 
ADJACENT 
SEGMENTS 
(STANDARD) 




STORE GRAPH ON SEGMENT BY 
SEGMENT BASIS, OF SURFACES WHICH 
EXTEND FROM THAT SURFACE INTO 
ADJACENT SEGMENTS IF ANY AND 
STORE POLYNOMIAL FOR THAT GRAPH 
(a complex algorithm) (This was the 
polynomial for segment 1 that was extended 
into segment 2) 



FIG. 10D 



STANDARD LOSSY TEXTURE 
COMPRESSION OF Id BY USING 
STANDARD METHODS SUCH AS DCT. 

WAVELET, FRACTAL AND 
INCLUDING ADDITIONAL LOSSLESS 
COMPRESSION STEP 



STORE Im AND V 
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LOSSLESS (STANDARD) 
COMPRESSION (HOFFMAN 
ENCODING) AND RUN LENGTH 
ENCODING OF CODED 
TEXTURE & DATERY 
(COEFFICIENTS) 



TO STORAGE OR 
COMMUNICATION 
LINK 



FIG, for 



FIG. 11 A 
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FIG. 13 A 




FIG. 13B 




FIG. 13C 



FIG. 14A 



FIG. 14B 



FIG. 14C 



T /a/xff/ T/»/xe/ T/>/xe/ 



FROM STORAGE 
OR 

COMMUNICATION 
CHANNEL 



DECODli LOSSLESS 
COMPRESSION 
DATA FROM 
ENCODER 







separAti 

THEl 


i I„, FROM 
3ATA 







TAKE FIRST GRAPH ^ 
OR SEGMENT (if no 



connections to otiier 
segments) 



YES 



NO 




FIG. 15 A 



CONNECT SEPARATE 

GRAPI][S USING 
STANDAFID SPLINES 



CONSTRUCT FRAME I„, 
USING SEGIvlENTS FROM 
STEP 5 ABOVE IN SAME 
WAY AS IN ENCODING 

STEP 18 FOR ENTIRE 
IMAGE AN13 ENCODING 
STEP 7 FOR 
SEGMENTATION 



CONSTRUCT SEGMENT i„ 

FOR EACH GRAPH AS IN 
ENCODING STEP 7 OF ABOVE 

ENCODING PROCESS OR 
SEGMENT USING 

POLYNOMIAL THAT WAS 
STORED FOR THAT GRAPH - 

SEE ENCODING STEP 16 




CREATE V FROM !„' + \i 



FINISH 



FIGJ5B 




Ill 















1 







111 



FOR EACH 
MICROBLOCK IN 
CURRENT FRAME 



READ ERROR BUFFER 
IN COMPRESSION 
PROCESSOR 



CREATE ACCUMULATED 
ERROR. Eaccum. BUFFER 
IN SOFTWARE FOR EACH 
MICROBLOCK OF FRAME 



YES 



START NEW I 
FRAME 



CONTINUE 
STANDARD 
COMPRESSION AND 
GRAB NEXT B, P 
FRAMES 



FIG. 18 




# 


Category 


Data Reduction 
in Fraction of 
Original 


Reduced 
Data Rate 


Object Category Description 


1. 


A 


100% 


128 kbps 


Original; possibly with noise. 


2. 


B 


75% 


96 kbps 


Tiny details of the face (or other 
biological signature, such as a 
fingerprint or retina); slightly 
reduced texture; edges remain 
unchanged. 


3. 


C 


50% 


84 kbps 


Hardened edges, wrinkles, smooth 
transitions for face details. 


4. 


D 


25% 


32 kbps 


Heavily reduced texture, hard 
edges. 


5. 


E 


10% 


12.8 kbps 


Hard edges, "cartoon- type" faces. 



FIG. 19 



